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INDEX IMPARTING SYSTEM USING CONTROL SIGNAL 

FIELD OF THE INVENTION 
The present invention relates to an index 
imparting technology of automatically imparting an 
index by using various kinds of control signals used 
at a program creating site in a broadcast station 
system . 

BACKGROUND OF THE INVENTION 
As a means of automatically imparting an index 
in a broadcast program, generally adopted is the 
means of: identifying a program performer or a 
speaker in a specific scene by using a face image 
recognition technology, a telop character 
recognition technology, a voice recognition 
technology, or a speaker recognition technology; 
transforming the result into metadata; and imparting 
an index. For example, as disclosed in JP-A No. 
167583/1999, there is a means of recognizing a 
character string of a telop and thereby imparting 
the result to a picture as metadata. Here, the term 
^^metadata" means data describing identifiers, names, 
performers, subjects and others in the contents of a 
broadcast program and the like. 

In the case of a face image recognition 
technology, the recognition rate has varied in 
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response to a screen position, a background picture, 
simultaneous display of plural objects and the like, 
and it has been difficult to obtain metadata of a 
high degree of accuracy. In the case of a telop 
character recognition technology too, a display 
position of telop characters, a background picture, 
a character font and the like have been restricted, 
and it has been difficult to realize the recognition 
of high probability which is not affected by 
environments. Further, in the cases of a voice 
recognition technology and a speaker recognition 
technology too, false recognition has occurred 
frequently in a program wherein plural speakers 
appear in a mixed manner or an indefinite number of 
speakers appear frequently, and the load of manual 
reconditioning work has been required likewise. 

In consequence, when one of the above 
technologies is used, manual intervention 
(reconditioning work) has been necessary in order to 
impart accurate metadata and the reality has been 
far from the automatic impartment of metadata which 
can minimize manual reconditioning work. 

SUMMARY OF THE INVENTION 
The present invention has been established in 
view of the above situation and the object thereof 
is to provide an index imparting system which is 



2 



capable of avoiding reconditioning work, 
automatically generating accurate metadata, and 
automatically imparting information relevant to a 
program . 

An automatic index imparting system according 
to the present invention, which is an index 
imparting system which automatically imparts 
metadata by using control signals of various kinds 
of devices used in a broadcast station, is 
characterized by including: a control signal 
detecting section to identify the type of each 
control signal and an identifier for uniquely 
specifying each control signal following the 
detection of various kinds of control signals and 
obtain the time of the detection; a control signal 
attribute information managing section to manage the 
identifier of a control signal and attribute 
information relevant thereto in a tied manner 
beforehand and then identify the attribute 
information on the basis of an identifier obtained 
at the control signal detecting section; and an 
index generating section to generate metadata 
following the acquisition of a type, an identifier, 
and time identified at the control signal detecting 
section and, in the meantime, impart the attribute 
information obtained by the request from the control 
signal attribute information managing section to the 
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metadata . 

Further, an automatic index imparting system 
according to the present invention is characterized 
by including a log analyzing section to generate log 
data wherein time is sorted for each identifier 
following the acquisition of an identifier and time 
from the control signal detecting section and output 
the log data to the index generating section. The 
log analyzing section is characterized by including: 
a log output section to generate log data wherein 
time is sorted for each identifier by using an 
identifier and detected time of a control signal and 
output the log data to a network or a removable 
medium; and a log input section to input the log 
data via the network or the removable medium and 
send the log data to the index generating section. 

Furthermore, an automatic index imparting 
system according to the present invention is 
characterized in that the control signal attribute 
information managing section includes a database 
searching section connected to a database which 
stores detailed information of attribute information 
and automatically imparts the detailed information 
obtained from the database to metadata generated at 
the index generating section. Here, the database 
which stores detailed information of attribute 
information is characterized by being a database 
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which stores detailed information on at least any 
one of a person, news, and a script. 

In the present invention, a control signal 
detecting section is configured so as to detect 
various kinds of control signals used during the 
broadcast of a program, identify the type, the 
identifier, and the time of each control signal and 
automatically generate metadata following the 
acquisition of them by an index generating section. 
Further, the index generating section is configured 
so as to request and obtain attribute information 
tied to the identified identifier from a control 
signal attribute information managing section 
wherein each of the identifiers of the various kinds 
of control signals and the attribute. information 
thereof are managed in a tied manner and 
automatically impart the attribute information to 
the metadata. That is, the present invention makes 
it possible to automatically generate metadata 
showing a variety of information composing program 
broadcast in a synchronizing manner during the 
broadcast of the program and yield the effects of 
allowing conventional manual metadata generating 
work to be considerably reduced and accurate 
information to be imparted. 

Further, by the present invention, since it is 
configured so as to generate log data wherein time 
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is sorted for each identifier and output the log 
data to the index generating section by using a log 
analyzing section, it is possible to generate 
metadata collectively by using the log data. 
Furthermore, by generating the log data, it is 
possible to automatically generate metadata showing 
a variety of information composing program broadcast 
at any time during the broadcast of the program even 
when it is not synchronized and yield the effects of 
allowing conventional manual metadata generating 
work to be considerably reduced and accurate 
information to be imparted. 

In addition, by the present invention, it is 
possible to obtain detailed information relevant to 
a person, news, a script, and others from another 
database by further using attribute information 
obtained on the basis of an identifier as a 
retrieval key and impart the detailed information to 
metadata. Thereby, it is possible to automatically 
generate accurate metadata containing plentiful 
information even when the obtained attribute 
information is insufficient. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a block diagram showing a general 
configuration of an index imparting system according 
to an embodiment of the present invention; 



6 



r 



Fig. 2 is a block diagram showing a system 
operation type of an index imparting system used in 
a broadcast station (Embodiment 1); 

Fig. 3 is a block diagram showing an internal 
configuration of a control signal detecting section; 

Fig. 4 is a block diagram showing an internal 
configuration of a control signal detecting section 
to detect a voice pressure level; 

Fig. 5 is a view showing a structure of a 
digitized control signal; 

Fig. 6 is a table showing a configuration of 
data which is managed at a control signal type 
managing section; 

Fig. 7 is a block diagram showing an internal 
configuration of a control signal attribute 
information managing section; 

Fig. 8 illustrates tables showing a 
corresponding relationship between an identifier and 
attribute information registered in an attribute 
information database (pin microphone); 

Fig. 9 is a flowchart showing the process of 
judging the voice pressure level of a voice control 
signal ; 

Fig. 10 is a flowchart showing the process of 
detecting a voice control signal and requesting 
metadata generation; 

Fig. 11 is a diagram schematically showing 
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various kinds of pin microphones and the start time 
and end time when each of the pin microphones is 
used; 

Fig. 12 shows an example of expressing index 
information generated by detecting a voice control 
signal in the form of XML; 

Fig. 13 illustrates tables showing a 
corresponding relationship between an identifier and 
attribute information registered in an attribute 
information database (VCR) / 

Fig. 14 shows an example of expressing index 
information generated by detecting a VCR control 
signal in the form of XML; 

Fig. 15 illustrates tables showing a 
corresponding relationship between an identifier and 
attribute information registered in an attribute 
information database (telop); 

Fig. 16 shows an example of expressing index 
information generated by detecting a telop control 
signal in the form of XML; 

Fig. 17 is a block diagram showing an index 
imparting system when an external database is used; 

Fig. 18 is a block diagram showing an internal 
configuration of a control signal attribute 
information managing section when external databases 
are used; 

Fig. 19 illustrates tables showing information 
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registered in various kinds of external databases; 

Fig. 20 is a flowchart showing a process of 
obtaining information tied to attribute information 
from various kinds of external databases; 

Fig. 21 shows an example of imparting 
information obtained from an external database to 
index information and expressing the information in 
the form of XML (pin microphone); 

Fig. 22 shows an example of imparting 
information obtained from an external database to 
index information and expressing the information in 
the form of XML (telop); 

Fig. 23 is a block diagram showing a general 
configuration of an index imparting system according 
to an embodiment of the present invention 
(Embodiment 2); 

Fig. 24 is a block diagram showing a system 
operation type of an index imparting system used in 
a broadcast station (Embodiment 2); and 

Fig. 25 is a view showing log data generated 
following the acquisition of the type, the 
identifier, and the time of each of various kinds of 
control signals (pin microphone). 

BEST MODE FOR CARRYING OUT THE INVENTION 
Embodiments of the present invention are 
hereunder explained in detail in reference to 
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drawings. The gist of the present invention is to: 
detect control signals of various kinds of devices 
used in a station system for broadcasting programs 
at a control signal detecting section; obtain the 
type, the identifier, and the time of each control 
signal and generate metadata; further obtain 
attribute information tied to the control signal 
detected at the control signal detecting section 
from a control signal attribute information managing 
section; impart it to the metadata; thereby generate 
the metadata of a program automatically and 
accurately; and thus automatically impart the 
information to the metadata. Here, a type is the 
term used to identify the type of a device, and an 
identifier is the term imparted in order to uniquely 
specify a device of the same type. 
Embodiment 1 

A first embodiment according to the present 
invention is explained hereunder. Fig. 1 shows the 
configuration of the main block of an index 
imparting system according to an embodiment of the 
present invention. An index imparting system 10 
shown in Fig. 1 includes: a program broadcast studio 
system 11 to produce, record, and deliver a 
broadcast program; a control signal detecting 
section 12 to detect control signals output from the 
program broadcast studio system 11 when the program 
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is broadcast and identify the type, the identifier, 
the time, and others of each control signal; a 
control signal attribute information managing 
section 14 to manage the identifier of the control 
signal and attribute information relevant thereto in 
a tied manner beforehand and then identify attribute 
information on the basis of an identifier obtained 
at the control signal detecting section 12; and an 
index generating section 13 to generate metadata 
following the acquisition of a type, an identifier, 
detection time, and others from the control signal 
detecting section 12 and, in the meantime, impart 
attribute information obtained by the request from 
the control signal attribute information managing 
section 14 to the metadata. 

Fig. 2 is a block diagram showing a general 
configuration of a broadcast system which may be 
presumed when an index imparting system 10 is 
actually applied to a broadcast station and the like. 
The broadcast system mainly includes a studio 1 and 
a conditioning booth 2 which issues instructions to 
the studio 1, receives image signals, voice signals 
and others from the studio 1, and carries out the 
production, recording, and delivery work of a 
program . 

In the studio 1, disposed are pin microphones 
20 (Pml, Pm2, and Pm3 ) as microphones which 
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announcers and performers put on, studio cameras 30 
(StCi and Stc2), and others. Further, in the 
conditioning booth 2, in addition to the control 
signal detecting section 12, the index generating 
section 13, and the control signal attribute 
information managing section 14, which are shown in 
Fig. 1, there are disposed an editing switch 19 to 
unify management by incorporating a camera selecting 
switch 15 to select an on-air picture to be 
broadcast by changing a studio camera (StCl or StC2) 
in the studio 1, a VCR selecting switch 16 to change 
a picture recorded in a VCR, a telop selecting 
switch 17 to change a telop image to be inserted 
into a camera picture, and a voice selecting switch 
18 to select a voice to be collected by switching a 
microphone which is worn by a performer; a telop 
generator 50 to generate a telop image; a telop 
creator 51 to control the generating operation of a 
telop at the telop generator 50; a VCR controller 40 
to control the recording and reproducing operations 
of a VCR; an editing PC (personal computer) 41 to 
handle editing work of program broadcast materials; 
a cart machine 42 to actually implement reproduction 
treatment of a VCR; and a relay controller 60 to 
implement control for relay broadcasting. 

The editing switch 19 is connected to the 
control signal detecting section 12 and the control 
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signal detecting section 12 detects various kinds of 
control signals sent from the editing switch 19. 
That is, the control signal detecting section 12 
detects the input of control signals, which various 
devices output, such as pin microphone voice signals 
output from the pin microphones 20, studio camera 
switching signals output from the studio cameras 30, 
VCR switching signals output from the VCR controller 
40, telop switching signals output from the telop 
generator 50, and others. Here, the pin microphones 
20, the studio cameras 30, the VCR controller 40, 
the editing PC 41, the cart machine 42, the telop 
generator 50, the telop creator 51, the relay 
controller 60, and others are connected as shown in 
Fig. 2. 

Next, the internal configuration of the control 
signal detecting section 12 is explained with Fig. 3. 
The control signal detecting section 12 plays the 
roles of: detecting an input control signal; 
identifying the type and the identifier thereof; 
obtaining the time; and then requesting the 
generation of metadata from the index generating 
section 13. The control signal detecting section 12 
includes: a control signal type identifying section 
121 to detect a control signal and identify the type 
and the identifier thereof; a control signal type 
managing section 122 to manage a control signal and 
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the type and the identifier thereof in a tied manner 
in order to enable the identification of the control 
signal; a time obtaining section 125 to obtain the 
time when a control signal is detected; and an index 
generation requesting section 124 to send the 
identified type and identifier and the obtained time 
to the index generating section 13 and request the 
generation of metadata. Here, in the control signal 
type managing section 122, control signals are 
registered before the operation of a system and the 
types and the identifiers thereof are also 
registered beforehand. An identifier may be 
registered automatically following the registration 
of a control signal. 

The control signal type identifying section 121 
analyzes the header part of an input control signal 
and thereby identifies the type and the identifier 
thereof. A control signal is divided into two parts; 
a header part 200 containing information on the type 
and the identifier thereof and others and a body 
part 201 including the control signal itself. The 
control signal type identifying section 121 analyzes 
the bit string of the header part 200 which 
represents the type of a signal, compares the result 
with a signal type 211 and a signal ID 210 
(identifier) which are registered in the control 
signal type managing section 122, and thereby 
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identifies the type and the identifier of the input 
control signal. Further, Fig. 4 shows the internal 
configuration of the control signal detecting 
section 12 in the case of judging the voice pressure 
level of a voice signal as a control signal. A voice 
input from a microphone 30 which is provided to a 
program performer is input into a microphone signal 
voice pressure level judging section 123 through a 
voice selecting switch 18. The microphone signal 
voice pressure level judging section 123 detects the 
voice pressure level of an input voice. 

Fig. 5 is a view showing an example of the 
structure of a digitized control signal. Information 
showing a signal type is allocated to the former 
eight bits of the header part 200 of a control 
signal and information showing an identifier 
uniquely specifying the signal type is allocated to 
the latter eight bits thereof. Fig. 6 is a table 
showing an example of the configuration of data 
which is managed at the control signal type managing 
section 122. The control signal type managing 
section 122 manages: information 211 to show the 
type of a control signal; identifier information 212 
to uniquely specify the signal type; a type 213 
corresponding to the signal type information 211; 
and a signal ID (identifier) 210 corresponding to 
the identifier information 212, in a tired manner in 
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the form of a table. 

When a control signal shown in Fig. 5 is input 
into the control signal type identifying section 121 
of the control signal detecting section 12, the 
control signal type identifying section 121 extracts 
the header part of the control signal and inquires 
the type and the identifier thereof from the control 
signal type managing section 122. At the control 
signal type managing section 122, since the former 
eight bits of the header part 200 showing the signal 
type information are [00000010], the control signal 
type managing section 122 judges that the item 
conforming to the type 213 tied to the signal type 
information 211 is ''pin microphone,'' and further, 
since the latter eight bits thereof are [00000001], 
the control signal type managing section 122 judges 
that the item conforming to the identifier 210 tied 
to the identifier information 212 is ^''PM-l." By so 
doing, the control signal type managing section 122 
judges that the type of the input control signal is 
^^pin microphone" and the identifier thereof is ^^PM- 
1," and notifies the control signal type identifying 
section 121 of the terms ^^pin microphone" and ^^PM- 
1 . " 

In this case here, although the control signal 
type identifying section 121 is notified of a type 
and an identifier, the control signal type 
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identifying section 121 may be notified of only the 
identifier ("PM-1") if the type can be identified 
from only the identifier. Further, the size, the 
position, and others of a bit string for the 
identification of the type and the identifier of a 
signal are not limited to the aforementioned example. 
Furthermore, with regard to the conversion process 
from an input signal to an identifier too, it is 
also acceptable: to identify the type and the 
identifier thereof directly from an analog signal; 
or to individually prepare input routes of a number 
corresponding to the number of control signals to be 
detected at the control signal type identifying 
section 121 and identify an input signal input from 
each of the separate input routes. In addition, it 
is also acceptable to prepare a GUI (graphical user 
interface) function at an editing switch 19, make 
the connection between an input signal and an 
identifier beforehand with the GUI, and convert the 
input signal to the identifier. 

Next, the internal configuration of the control 
signal attribute information managing section 14 is 
explained with Fig. 7. In the control signal 
attribute information managing section 14, various 
kinds of control signals and attribute information 
are registered beforehand in a tied manner. For 
example, the control signal attribute information 
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managing section 14 is configured so as to manage an 
identifier uniquely specifying a control signal and 
attribute information beforehand in a tied manner 
and identify the attribute information on the basis 
of an identifier which the control signal detecting 
section 12 has obtained. 

The control signal attribute information 
managing section 14 includes: an attribute 
information registering section 141 to register the 
identifiers and attribute information of various 
kinds of control signals; an attribute information 
managing section 142 to implement management 
including receiving registration from the attribute 
information registering section 141, registering the 
attribute information to an attribute information 
database 143, receiving attribute information 
requirement from the index generating section 13, 
and reading out attribute information from the 
attribute information database 143 on the basis of 
an identifier; and the attribute information 
database 143 to store the type and the identifier of 
a control signal and attribute information 
corresponding thereto in a tied manner. 

Attribute information can also be registered 
online from various kinds of devices used in a 
broadcast station instead of being registered 
manually by a person involved in the production or 
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edition of a program. For example/ it is possible 
to: divert information such as a character string 
created at a telop creator 51, a picture of a VCR 
edited at an editing PC 41 and the like; and 
register attribute information online in a manner of 
being tied to the identifier of each of the various 
kinds of devices. By so doing, the registration work 
of attribute information showing a character string, 
picture information and the like is alleviated. In 
addition to that, it is also possible to: store a 
character string and picture information created or 
edited and the like in a removable medium; and 
register attribute information by using the 
removable medium. 

Successively, the index generating section 13 
is explained. The index generating section 13 plays 
the roles of: generating metadata following the 
acquisition of the type and the identifier of a 
control signal and the detection time; and, in the 
meantime, requesting attribute information tied to 
the obtained identifier from the control signal 
attribute information managing section 14 and 
imparting the attribute information obtained from 
the control signal attribute information managing 
section 14 to the generated metadata. 

Next, hereunder explained is the flow of 
processes from the detection of control signals of 
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various kinds of devices to the generation of 
metadata in an index imparting system configured as 
stated above. 

<A case where the control signal of a pin microphone 
is detected> 

Firstly, the generation of metadata when a pin 
microphone is used is explained, A general style of 
program recording is that each of program performers 
puts on a pin microphone and thereby the pin 
microphone of a performer collects the voice of the 
performer's own. In the case of a news program and 
the like wherein clear voice is required in 
particular, a pin microphone capable of keeping the 
distance from the mouth of a speaker constant is 
preferably used. An advantage of the use of a pin 
microphone is that it hardly picks up voice spoken 
by other performers in addition to that the distance 
from the mouth of a speaker can easily be kept 
constant and a clear voice can be obtained as stated 
above. That is, it can be said that a pin microphone 
accumulates only voice spoken by a specific person 
and hence it is estimated that voice input into a 
pin microphone can be correlated with a specific 
person . 

As explained already, in the control signal 
type managing section 122 of the control signal 
detecting section 12, the control signals, the types 
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and the identifiers of various kinds of devices are 
registered before a program is broadcast and 
recorded. That is, the control signal, the type, and 
the identifier of a pin microphone are registered 
beforehand so as to be able to: identify the signal 
of the pin microphone when a voice control signal 
for the change to voice is detected; and further 
identify the pin microphone which has received the 
input, and, after the detection of the control 
signal, it is converted into a type and an 
identifier. In the meantime, the person who puts on 
a pin microphone (the person corresponding to an 
identifier) is registered to the control signal 
attribute information managing section 14 beforehand. 

Fig. 8 includes the tables showing the 
relationship between a pin microphone identifier 
registered in the attribute information database 143 
of the control signal attribute information managing 
section 14 and a performer who puts on the pin 
microphone and it is assumed in Fig. 8 that an 
identifier corresponding to a signal which a pin 
microphone outputs and a pin microphone wearer are 
registered and managed in pairs. Fig. 8 shows that 
PM-1, PM-2, and PM-3 as the identifiers of pin 
microphones are tied to a performer A, a performer B, 
and a performer C, respectively, in a default state. 
The attribute information is subjected to renewal 
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processing for the attribute information registering 
section 141 at the stage of actually registering the 
performers and thereby Taro Yamada, Jiro Tanaka, and 
Hanako Suzuki who are the wearers of the pin 
microphones are tied, renewed and managed. Further, 
in the attribute information database 143, 
previously set attribute information is recorded and 
subsequently attribute information can easily be 
correlated with an identifier by a selecting means 
from the attribute information database 143 or 
another means. 

Fig. 9 is a flowchart showing the flow from the 
detection of the voice pressure level of a voice 
control signal input into a pin microphone until the 
voice control signal which has reached a certain 
voice pressure level is sent to the control signal 
type identifying section 121, and Fig. 10 is a 
flowchart showing the flow from the sending of the 
voice control signal to the control signal type 
identifying section 121 until the generation of 
metadata is requested. The flow of metadata 
generation processing is explained on the basis of 
the flowcharts shown in Figs. 9 and 10. When the 
recording of a program starts, a voice control 
signal from a pin microphone is input into the 
microphone signal voice pressure level judging 
section 12,3 of the control signal detecting section 
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12 via the voice selecting switch 18 every time a 
speech is made (S20 and S21) . 

In the microphone signal voice pressure level 
judging section 123, noise and the like are not 
regarded as speech and only a voice control signal 
which has reached a certain voice pressure level or 
higher is regarded as a speech and then the voice 
control signal is input into the control signal type 
identifying section 121. In contrast, a voice 
control signal which does not reach a certain voice 
pressure level or higher is regarded as no speech 
being made or a speech being finished and thus the 
voice control signal is not input into the control 
signal type identifying section 121 or the finish of 
the speech is notified. 

More specifically whether or not the voice 
pressure level of an input voice control signal 
exceeds a prescribed value is judged (S22). When the 
voice pressure level exceeds the prescribed value, a 
speech flag (internal flag to judge whether or not a 
speaker has already started a speech) is confirmed 
(S23). And when the speech flag is lowered, the 
speech flag of the relevant signal ID is raised 
(S25), the voice control signal is input into the 
control signal type identifying section 121, and the 
fact that the speech is started is notified (S27). 
In the same way, when the voice pressure level of a 
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voice control signal input when the speech flag is 
raised is lower than a prescribed value, the speech 
flag is lowered (S24), the voice control signal is 
input into the control signal type identifying 
section 121, and the fact that the speech has been 
finished is notified (S27). In this case, it has 
been explained that, in order to detect the start or 
finish of a speech, only when a voice pressure level 
exceeds or is lower than a prescribed level, the 
fact is notified to the control signal type 
identifying section 121. However, it is also 
possible to judge that a speech has been made only 
when a voice pressure level is attained continuously 
for a certain period of time, and send the voice 
control signal to the control signal type 
identifying section 121. Further, it is also 
possible to send a voice control signal to the 
control signal type identifying section 121 only 
when a voice pressure level is lower than a 
prescribed value continuously for a certain period 
of time . 

When a voice control signal is input into the 
control signal type identifying section 121, the 
control signal type identifying section 121 extracts 
the header part thereof, sends it to the control 
signal type managing section 122, and inquires the 
type and the identifier corresponding to the voice 
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control signal. The control signal type managing 
section 122 identifies the type and the identifier 
of the voice control signal on the basis of the 
signal type information and the signal identifier 
shown in the header part 200, and notifies the 
control signal type identifying section 121 of the 
type and the identifier. In this case, if the type 
can be identified only from the identifier (refer to 
Fig. 6), it is possible to notify only of the 
identifier (S12) . 

The control signal type identifying section 121, 
following the acquisition of a type and an 
identifier, sends the type and the identifier to the 
index generation requesting section 124, and, 
following that, the index generation requesting 
section 124 inquires the present time from the time 
obtaining section 125 and obtains the time (S13) . 
The index generation requesting section 124, 
following the acquisition of the type, the 
identifier, and the time of a voice control signal, 
sends them to the index generating section 13 and 
requests to generate an index (metadata) (S14) . 

The index generating section 13 generates 
metadata following the acquisition of a type, an 
identifier, and time from the control signal 
detecting section 12 (the index generation 
requesting section 124), and in the meantime, sends 
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the type and the identifier to the control signal 
attribute information managing section 14 and 
inquires the attribute information. The control 
signal attribute information managing section 14 
obtains the attribute information which is managed 
in a tied manner on the basis of the sent type and 
identifier^ and sends the attribute information to 
the index generating section 13. The index 
generating section 13 imparts the attribute 
information to the generated metadata following the 
notification of the attribute information. By 
carrying out the above processing every time the 
control signal detecting section 12 detects a voice 
control signal, it is possible to generate metadata 
wherein the start time and the finish time of speech 
of a performer who puts on a pin microphone are 
sorted for each performer. 

Fig. 11 is a diagram schematically showing the 
relationship between the type and the identifier of 
a control signal generated at the index generating 
section 13 and the attribute information thereof. 
For example, the diagram shows that voice signals 
from the signal ID PM-1 of a control signal are 
detected at the time periods between tl and t2, t3 
and t4, and t5 and t6, and a speaker at a certain 
time zone can be specified. Fig. 12 shows an example 
of expressing the above processing results in the 
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form of XML (extensible Markup Language) and the 
start time and the finish time of speech of a 
speaker can be recognized at a glance. 

As stated above, the control signal detecting 
section detects a voice control signal which 
controls a voice simultaneously with the start of 
speech of a program performer and thereby it is 
possible to generate metadata from the information 
on the timing of the speech and the identity of the 
performer automatically and accurately. Further, by 
imparting also the attribute information, 
significant cost reduction can be attained in 
comparison with the manual metadata generation which 
has conventionally been adopted. 

Further, another idea is to specify the content 
of speech by applying not only the identification of 
a speaker and the time of speech but also a voice 
recognition technology to a voice signal from a pin 
microphone. In this case, it is also possible to 
impart information about the content of speech by 
adding the voice recognition result to a speaker 
identifying information XML shown in Fig. 12. 
<A case where the control signal of a VCR is 
detected> 

Next, the generation of metadata when a VCR is 
used is explained. In a live broadcast program 
typified by a news program, there are many cases 
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where an edited VCR picture is broadcast as a 
feature or a topic. A VCR is edited at and output 
from the editing PC 41. 

Further, the control signals, the types, and 
the identifiers of various kinds of devices are 
registered in the control signal type managing 
section 122 of the control signal detecting section 
12 before the system is operated. That is, when a 
VCR is selected with the VCR controller 40 during 
the broadcast of a program, the control signal 
detecting section 12 detects the VCR control signal 
output from the VCR selecting switch 16 and further 
the control signal, the type, and the identifier of 
the VCR are registered beforehand so as to be able 
to identify the VCR of the input. Further, it is 
assumed that a VCR records also the title, the 
content, the shooting place, the time, and others at 
the time of editing. Such attribute information is 
registered also in the control signal attribute 
information managing section 14 and the attribute 
information (the title in this case) and the 
identifier are managed in a tied manner in order to 
identify the relevant VCR. Here, the attribute 
information and the identifier registered in the 
control signal attribute information managing 
section 14 can also be registered by on-line 
connection from the editing PC 41. Thereby, the 
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attribute information and the identifier generated 
around the same time as the VCR editing are 
automatically registered as they are in the control 
signal attribute information managing section 14. 
Further, instead of on-line registration, it is also 
possible to record attribute information and an 
identifier in a removable medium such as a CD-ROM, a 
flexible disk, a DVD, an SD memory card and the like, 
and register them in the control signal attribute 
information managing section 14 with the removable 
medium • 

Fig. 13 shows the relationship between a VCR 
identifier and a VCR title registered in the 
attribute information database 143 of the control 
signal attribute information managing section 14, 
and it is assumed that the identifier and the title 
of a VCR are managed and registered in a set. In Fig. 
13, VCR-1, VCR-2, and VCR-3, which are the 
identifiers of the VCRs, are managed in the state of 
being tied to the titles of the shot pictures; 
^^burned body case follow-up story, " ^^Nagata-cho on 
the eve of dismissal," and '^Sports feature picture," 
respectively. Here, with regard to the attribute 
information registered in the attribute information 
database 143, in addition to the title of a VCR, 
information on the content, the time, the shooting 
place, the performers, the recording time, and 
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others of a VCR may be managed in a tied manner. 

During the broadcast of a program, an assigned 
VCR is broadcast with the VCR controller 40 by 
operating the VCR selecting switch 16 in an 
editorial room, and at the same time a VCR control 
signal is input into the control signal type 
identifying section 121 of the control signal 
detecting section 12. When a VCR control signal is 
input into the control signal type identifying 
section 121, in accordance with the processing flow 
shown in Fig. 10, the control signal type 
identifying section 121 extracts the header part 
thereof, sends it to the control signal type 
managing section 122, and inquires the type and the 
identifier corresponding to the VCR control signal. 
The control signal type managing section 122 
identifies the type and the identifier of the VCR 
control signal on the basis of the signal type 
information and the signal identifier shown in the 
header part 200, and notifies the control signal 
type identifying section 121 of the type and the 
identifier. In this case here, if the type can be 
identified from only the identifier (refer to Fig. 
6), it is possible to notify only of the identifier. 

The control signal type identifying section 121, 
following the acquisition of a type and an 
identifier, sends the type and the identifier to the 
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index generation requesting section 124, and, 
following that, the index generation requesting 
section 124 inquires the present time from the time 
obtaining section 125 and obtains the time. The 
index generation requesting section 124, following 
the acquisition of the type, the identifier, and the 
time of a voice control signal, sends them to the 
index generating section 13 and requests to generate 
an index (metadata) . 

The index generating section 13 generates 
metadata following the acquisition of a type, an 
identifier, and time from the control signal 
detecting section 12 (the index generation 
requesting section 124), and in the meantime, sends 
the type and the identifier to the control signal 
attribute information managing section 14 and 
inquires the attribute information. The control 
signal attribute information managing section 14 
obtains the attribute information which is managed 
in a tied manner on the basis of the sent type and 
identifier, and notifies the index generating 
section 13 of the attribute information. The index 
generating section 13 imparts the attribute 
information to the generated metadata following the 
notification of the attribute information. 

By carrying out the above processing every time 
the control signal detecting section 12 detects a 
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VCR control signal output from the editing switch 19 
simultaneously with the control of the VCR, it is 
possible to generate metadata wherein the time when 
the VCR is used is sorted for each VCR and impart 
the attribute information. Fig. 14 shows an example 
of expressing the above processing results in the 
form of XML and the time when the VCR is broadcast 
and the title of the VCR can be recognized at a 
glance . 

As stated above, it is possible to generate 
metadata automatically and accurately from 
information on the time when a VCR is used by 
detecting a VCR control signal with the control 
signal detecting section simultaneously with the use 
of the VCR, and further it is possible to 
considerably reduce man-hours by imparting also the 
attribute information in comparison with the 
conventional manual metadata generation. 
<A case where the control signal of a telop is 
de tected> 

Next, the generation of metadata when a telop 
is used is explained. In the broadcasting of a 
program, there are many cases where telops such as 
the name of a person, date and time, a location, 
contents, and others are used to assist the 
explanation on a screen. A telop such as a telop 
document processing tool is created and output with 
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a telop creator 51, to carry out electronic 
processing . 

Further, the control signals, the types, and 
the identifiers of various kinds of devices are 
registered in the control signal type managing 
section 122 of the control signal detecting section 
12 before the system is operated. That is, when a 
telop is used with the telop generator 50 during the 
broadcast of a program, the control signal detecting 
section 12 detects the telop control signal output 
from the telop selecting switch 17 and further the 
control signal, the type, and the identifier of the 
telop are registered beforehand so as to be able to 
identify the telop of the input. Further, it is 
assumed that a telop records also information 
including the character string, the type of the 
character string, the font, the character style, the 
color, and others at the time of creating. Such 
attribute information is registered also in the 
control signal attribute information managing 
section 14 and the attribute information (the 
character string in this case) and the identifier 
are managed in a tied manner in order to identify 
the relevant telop. Here, the attribute information 
and the identifier registered in the control signal 
attribute information managing section 14 can also 
be registered by on-line connection from the telop 
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creator 51, Thereby, the attribute information and 
the identifier generated around the same time as the 
telop creating are automatically registered as they 
are in the control signal attribute information 
managing section 14. Further, instead of on-line 
connection, it is also possible to record attribute 
information and an identifier in a removable medium 
such as a CD-ROM, a flexible disk, a DVD, an SD 
memory card and the like, and register them in the 
control signal attribute information managing 
section 14 with the removable medium. 

Fig. 15 shows the relationship between a telop 
identifier and a telop character string registered 
in the attribute information database 143 of the 
control signal attribute information managing 
section 14 and it is assumed that the identifier and 
the character string of a telop are managed and 
registered in a set. In Fig. 15, TP-1, TP-2, TP-3, 
and TP-4, which are the identifiers of the telops, 
are managed in the state of tied to the character 
strings of the created telops and the types; ''^Taro 
Yamada, personal name," '''Jiro Sato, personal name," 
^^burned body case follow-up story, topic name," and 
^^Nagata-cho on the eve of dismissal, topic name," 
respectively. Here, with regard to the attribute 
information registered in the attribute information 
database 143, in addition to the character string of 
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a telop and the type thereof, information on the 
font, the character style, the color of a telop, and 
others may be managed in a tied manner. 

During the broadcast of a program, an assigned 
telop is broadcast with the telop generator 50 by 
operating the telop selecting switch 17 in an 
editorial room, and at the same time a telop control 
signal is input into the control signal type 
identifying section 121 of the control signal 
detecting section 12. When a telop control signal is 
input into the control signal type identifying 
section 121, in accordance with the processing flow 
shown in Fig. 10/ the control signal type 
identifying section 121 extracts the header part 
thereof, sends it to the control signal type 
managing section 122, and inquires the type and the 
identifier corresponding to the telop control signal. 
The control signal type managing section 122 
identifies the type and the identifier of the telop 
control signal on the basis of the signal type 
information and the signal identifier shown in the 
header part 200, and notifies the control signal 
type identifying section 121 of the type and the 
identifier. In this case here, if the type can be 
identified from only the identifier (refer to Fig. 
6), it is possible to notify only of the identifier. 
The control signal type identifying section 121, 
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following the acquisition of a type and an 
identifier, sends the type and the identifier to the 
index generation requesting section 124, and, 
following that, the index generation requesting 
section 124 inquires the present time from the time 
obtaining section 125 and obtains the time. The 
index generation requesting section 124, following 
the acquisition of the type, the identifier, and the 
time of a voice control signal, sends them to the 
index generating section 13 and requests to generate 
an index (metadata) . 

The index generating section 13 generates 
metadata following the acquisition of a type, an 
identifier, and time from the control signal 
detecting section 12 (the index generation 
requesting section 124), and in the meantime, sends 
the type and the identifier to the control signal 
attribute information managing section 14 and 
inquires the attribute information. The control 
signal attribute information managing section 14 
obtains the attribute information which is managed 
in a tied manner on the basis of the sent type and 
identifier; and notifies the index generating 
section 13 of the attribute information. The index 
generating section 13 imparts the attribute 
information to the generated metadata following the 
notification of the attribute information. 
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By carrying out the above processing every time 
the control signal detecting section 12 detects a 
telop control signal output from the editing switch 
19 simultaneously with the control of the telop, it 
is possible to generate metadata wherein the time 
when the telop is used is sorted for each telop and 
impart the attribute information. Fig. 16 shows an 
example of expressing the above processing results 
in the form of XML and the time when the telop is 
broadcast and the identity of the telop can be 
recognized from the XML at a glance. 

As stated above, it is possible to generate 
metadata automatically and accurately from 
information on the time when a telop is used by 
detecting a telop control signal with the control 
signal detecting section simultaneously with the use 
of the telop, and further it is possible to 
considerably reduce man-hours by imparting also the 
attribute information in comparison with the 
conventional manual metadata generation. Although 
false recognition has occurred and wrong metadata 
has been imparted since information has been 
obtained by recognizing the character string itself 
of a telop in the case of a conventional metadata 
generating technology of using a telop, it never 
happens that wrong metadata is imparted in the case 
of the present invention. 
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<A case where the control signal of a camera is 
detected> 

Next, the generation of metadata when a studio 
camera is used is explained. A program is broadcast 
by using a large number of cameras placed in a 
studio, and shooting objects while switching the 
cameras. The studio cameras 30 are switched with the 
camera selecting switch 15 and, at the same time 
with this, the camera selecting switch 15 sends a 
camera control signal to the control signal 
detecting section 12. 

Further, the control signals, the types, and 
the identifiers of various kinds of devices are 
registered in the control signal type managing 
section 122 of the control signal detecting section 
12 before the system is operated. That is, when a 
camera control signal to switch a camera is sent, 
the control signal detecting section 12 detects that 
the camera is switched and further the control 
signal, the type, and the identifier of the camera 
are registered beforehand so as to be able to 
identify the switched camera. By detecting a camera 
control signal with the control signal detecting 
section 12 simultaneously with the switching of a 
camera, it is possible to generate metadata 
automatically and accurately from camera work 
information on a used camera. Further, by detecting 
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a camera control signal changed when a screen is 
switched from a relay picture to a studio picture, 
it is also possible to generate metadata from 
inserted information of the relay picture. 

In addition to those, by attaching an RF tag 
(radio frequency tag) to a program performer and 
disposing a reader to read a signal from the RF tag 
to a camera 30, it is possible to identify a 
performer currently appearing on a screen and 
generate metadata from the information. In this case, 
the signal, the type, and the identifier of the RF 
tag are registered before the system is operated in 
the control signal type managing section 122 of the 
control signal detecting section 12, and the 
identifier of the RF tag and the name, the date of 
birth, and others of a main performer which are used 
as attribute information on the performer to whom 
the RF tag is attached are registered in the 
attribute information database 143 of the control 
signal attribute information managing section 14 in 
a tied manner. 

Further, not by independently using such 
various kinds of control signals, but by detecting 
two or more control signals simultaneously with the 
control signal detecting section 12, it is possible 
to generate metadata automatically and accurately 
from information on the time of the use of the 
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various kinds of devices and further, by imparting 
the attribute information too, it is possible to 
generate metadata from a variety of information 
composing the program broadcast synchronously during 
the broadcasting of the program, and resultantly the 
effects of considerably reducing conventional manual 
metadata generating work and imparting accurate 
information can be obtained. 

<A case where an external database is used> 

Further, as shown in Figs. 17 and 18, it is 
possible for the control signal attribute 
information managing section 14 to include a 
database searching section 144 connected to a 
database storing detailed information of attribute 
information, and automatically impart the detailed 
information obtained from the database 70 to 
metadata generated at the index generating section 
13. In the present embodiment, the database 70 is 
provided with a personal information database 71, a 
news database 72, and a script database 73, and 
those are connected online. As shown in Fig. 19, in 
the personal information database 71, a personal 
name, a gender, a date of birth, a hometown, and 
others are managed in a tied manner. Further, in the 
news database 72, picture information, contents, a 
shooting space, and others are managed in a tied 
manner. Furthermore, in the script database 73, 
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character string information, picture information, a 
performer, and others are managed in a tied manner. 

Processing procedures up to metadata generation 
are explained hereunder with Fig. 20. In the control 
signal attribute information managing section 14, 
following the acquisition of the identifiers of 
various kinds of devices sent from the index 
generating section 13 by the attribute information 
managing section 142, the attribute information 
managing section 142 inquires of the attribute 
information database 143 whether or not attributed 
information tied to an identifier exists (S201). The 
attribute information database 143 searches 
attribute information tied to the identifier (S202) 
and notifies the attribute information managing 
section 142 of the attribute information. The 
attribute information managing section 142 ties the 
notified attribute information to the identifier 

(5203) and meanwhile sends the attribute information 
to the database searching section 144. The database 
searching section 144 inquires of the personal 
information database 71, the news database 72, and 
the script database 73 whether or not detailed 
information of the attribute information exists 

(5204) . Here, it is also possible to inquire the 
existence of the databases selectively. The 
databases 71 to 73 search detailed information tied 
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to the attribute information and notify the 
attribute information managing section 142 through 
the database searching section 144 of the detailed 
information- The attribute information managing 
section 142 ties the attribute information obtained 
from the attribute information database 143 to the 
detailed information obtained from the databases 71 
to 73 and notifies the index generating section 13 
(S206) . 

Although the above processing is based on the 
case of searching for detailed information on 
attribute information tied to single identifier, 
when plural attribute information pieces exist in 
plurality, detailed information is searched for by 
using new attribute information as a retrieval key. 
Then, the control signal attribute information 
managing section 14 sends detailed information 
searched for on the basis of the attribute 
information together with the attribute information 
to the index generating section 13, and then the 
index generating section 13 imparts the notified 
attribute information and detailed information to 
generated metadata. Figs. 21 and 22 show examples of 
metadata to which attribute information and detailed 
information are imparted. 

As stated above, the control signal attribute 
information managing section is provided with the 
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database searching section 144 to search for the 
detailed information of attribute information 
managed by the control signal attribute information 
managing section, and thereby, with regard to 
attribute information obtained on the basis of an 
identifier, the control signal attribute information 
managing section can obtain the detailed information 
thereof from the external databases 71 to 73 and 
impart the detailed information to metadata. Since 
detailed information can be obtained on the basis of 
attribute information tied to an identifier, the 
amount of attribute information managed by the 
control signal attribute information managing 
section 14 can be reduced to the minimum. 

As stated above, in the present embodiment, the 
situation of various kinds of devices used in 
program broadcasting is configured so that the 
control signal detecting section detects control 
signals of those devices, identifies the types and 
the identifiers thereof, and obtains the times. Then 
metadata is automatically generated following the 
acquisition of the types, the identifiers, and the 
times by the index generating section. Further, it 
is configured so that the index generating section 
requests attribute information tied to an identified 
identifier from the control signal attribute 
information managing section wherein the identifiers 
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of various kinds of control signals and the 
attribute information thereof are managed in a tied 
manner, obtains the attribute information and 
automatically imparts the attribute information to 
metadata. That is, in the present embodiment, it is 
possible to automatically generate metadata showing 
a variety of information composing program broadcast 
in synchronization during the broadcasting of a 
program and thus the effects of considerably 
reducing conventional manual metadata generating 
work and imparting accurate information can be 
obtained. Further, since it is also possible to 
obtain detailed information from another database on 
the basis of attribute information tied to an 
identifier and impart it to metadata, it is possible 
to automatically generate metadata containing 
accurate detailed information and affluent 
information by obtaining detailed information using 
the attribute information as the retrieval key even 
in the case of a small amount of attribute 
information . 
Embodiment 2 

The second embodiment according to the present 
invention is hereunder explained. In Embodiment 1, 
metadata is automatically generated in 

synchronization during the broadcasting of a program 
with regard to a variety of information composing 
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the program broadcast. However, the features of the 
present embodiment are to output log data as 
intermediate data and to generate metadata by 
inputting the log data asynchronously during the 
broadcasting of a program. Fig. 23 shows the 
configuration of a main block of an index imparting 
system according to an embodiment of the present 
invention. The same components as those in the index 
imparting system shown in Fig. 1 are represented by 
the same reference numerals, and duplication of 
explanations is avoided. The difference in 
configuration from the system shown in Fig. 1 is 
that the system of this case is provided with a log 
analyzing section 230. The log analyzing section 230 
plays the role of generating and outputting log data 
following the acquisition of the type, the 
identifier, and the time of a control signal coming 
from the control signal detecting section 12. As 
shown in Fig. 25, log data is data produced by 
sorting time for each identifier. Further, as shown 
in Fig. 24, the log analyzing section includes a log 
output section 241 to generate log data and output 
the log data to a network or a removable medium 243; 
and a log input section 242 to input and send the 
log data to the index generating section 13. Here, 
the network cited here is thought to be online 
connected, and the removable medium 243 is thought 
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to be a recording medium such as a CD-ROM, a 
flexible disk, a DVD, an SO memory card and the like. 
Further, the log analyzing section 230 does not need 
the intervention of a network or a recording medium, 
and may merely be a block which generates log data 
wherein time is sorted for each identifier and 
outputs the log data or may be physically integrated 
into one unit . 

The log output section 241 of the log analyzing 
section 230 sorts time for each identifier and 
generates log data following the acquisition of the 
identifier and the detection time of a control 
signal coming from the control signal detecting 
section 12 (refer to Fig. 25). The log data shown in 
the figure is produced by logging the control signal 
of a pin microphone for each identifier. The pin 
microphone recognizes the start time and the finish 
time of a speech and hence the times shown here are 
shown in the state where the start and finish of a 
speech by a performer are repeated. 

The generated log data is input into the log 
input section 242 from the log output section 241 
through a network or a removable medium 243 and the 
log input section 242 sends the log data to the 
index generating section 13. The index generating 
section 13 generates such metadata as shown in Fig. 
12 following the acquisition of the log data wherein 
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time is sorted for each identifier by the index 
generating section 13. Since time is sorted for each 
identifier in the log data, it is possible to 
generate metadata collectively. 

Meanwhile, the index generating section 13 uses 
an identifier shown in log data and thereby inquires 
attribute information managed in a tied manner from 
the control signal attribute information managing 
section 14. The control signal attribute information 
managing section 14, when it receives an identifier 
from the index generating section 13, obtains the 
tied attribute information and notifies the index 
generating section 13 of the attribute information, 
and thereby the index generating section 13 imparts 
the attribute information to generated metadata. 

Note that, although log data generated when a 
pin microphone control signal is detected have been 
explained as an example in the present embodiment, 
even in the case of detecting the control signal of 
a VCR, a telop, a camera, or an RF tag as explained 
in Embodiment 1, it is possible to generate log data 
likewise and generate such metadata as shown in Figs. 
14 and 16 in the same way as Embodiment 1. Further, 
it is also possible that, by using attribute 
information obtained from an identifier shown in log 
data as a retrieval key, the control signal 
attribute information managing section 14 is 
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configured so as to access the personal information 
database 11, the news database 12, and the script 
database 73 from the database searching section 144 
and obtain detailed information. In this case, such 
metadata as shown in Figs. 21 and 22 are generated 
in the same way as Embodiment 1. 

As stated above, in the present embodiment, the 
situation of various kinds of devices used in 
program broadcasting is configured so as to detect 
control signals of those devices, identify the types 
and the identifiers thereof, obtain the times, and 
when the log analyzing section obtains those, 
generate log data wherein the time is sorted for 
each identifier. Then the index generating section 
is configured so as to automatically generate 
metadata following the acquisition of generated log 
data by the index generating section. Further, the 
index generating section is configured so as to 
request and obtain attribute information tied to an 
identified identifier from the control signal 
attribute information managing section wherein the 
identifiers of various kinds of control signals and 
the attribute information thereof are managed in a 
tied manner, and automatically impart the attribute 
information to metadata. That is, in the present 
embodiment, by using the type, the identifier, and 
the time of an identified control signal and 
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generating log data wherein the time is sorted for 
each identifier, it is possible to realize the 
automatic generation of metadata from a variety of 
information composing program broadcast at an 
arbitrary timing even asynchronously during the 
shooting of the program, for example, in the case 
where metadata is generated from log data after the 
completion of editing work of a recorded picture in 
the recording of the program picture, and the 
effects of considerably reducing conventional manual 
metadata generating work and imparting accurate 
information can be obtained. 

As explained above in detail, in program 
broadcast at a broadcast station, by setting various 
kinds of control signals used during the 
broadcasting and information attribute to the 
signals as attribute information beforehand, it is 
possible to automatically generate metadata by using 
the detection of a control signal as the trigger. 
Further, it is possible to carry out accurate 
indexing and obtain the effect of avoiding the 
trouble of manual reconditioning work. Furthermore, 
by online connection to a VCR editing device, a 
telop creating device and the like, it is also 
possible to simplify preliminary manual setting of 
attribute information . 
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